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Instruction controlled data processing device 



The invention relates to an instruction controlled data processing device. 

PCT patent application No. WO00/60457 discloses a VLIW processing 
device. A VLIW processing device contains a plurality of functional units that are each 
capable of executing an instruction in parallel with other functional units. A VLIW 
5 processing device processes VLIW instruction words that each generally contain a plurality 
of instructions for execution in parallel by respective functional units. A VLIW processor has 
the advantage of enabling high-speed execution of programmed processing tasks, but this 
advantage is bought at the expense of high memory use and high power consumption. 
WO00/60457 aims to reduce the instruction memory size needed for programs for VLIW 
10 processing devices. For this purpose the processing device composes VLIW instructions in 
response to instructions in a memory. Thus, an original instruction from memory is translated 
into a plurality of instructions in a VLIW instruction word, to be executed in parallel with 
different functional units. 

High power consumption is caused, among others, by the need to issue many 
IS instructions in parallel and the need to access a register file for each issued instruction. These 
problems are not addressed by WO00/60457. 

Among others, it is an object of the invention to provide for a reduction of 
power consumption in an instruction controlled processing device. 

Among others, it is an object of the invention to provide for a reduction of 
20 power consumption in particular in a VLIW processing device. 

The device according to the invention is set forth in Claim 1 . This device 
contains a group of functional units that are connected in parallel to an issue slot and ports of 
a register file, for alternatively executing instructions issued from the issue slot with operands 
from at least one port and writing results to at least one port. In addition to these alternative 
25 instructions, the device provides for a combination instruction in response to which more 
than one functional unit from the group responds, a result from a first one of the functional 
units being routed to an operand input of a second one of the functional units in response to 
the combination instruction. The result of the second one of the functional units is used to 
produce the result of the combination instruction. By using a combination instruction, one 
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can reduce the number of instructions that needs to be issued to the group of functional units 
during execution of a program for a give task, thereby reducing power consumption. In 
contrast to WO00/60457, the combination instruction is not split out into multiple 
instructions that have to be issued separately, but issued in one issue slot. Thus, the device 
5 partly goes against the philosophy of VLI W processing, by partly avoiding the need to issue 
instructions for different functional units in parallel, even though, of course, other 
instructions may be issued in parallel with the combination instruction in a same VLIW 
instruction word. 

In an embodiment the processing device has a selectable clock rate for 

10 instruction cycles. By reducing the clock rate used during execution of processing tasks that 
do not need a higher clock rate, power consumption is reduced. When a processing task has 
to be executed at high speed the clock rate is increased up to a maximum at which all 
individual functional units can just execute the instruction within one instruction cycle. 
According to one aspect of the invention the device is constructed so that more than one 

15 functional unit responds to the combination instruction in the same instruction cycle, acting 
in series, and the clock rate can be increased to such a high speed that the series execution of 
the combination instruction no longer fits within one instruction cycle. When the clock rate is 
increased to such a level, use of the combination instruction is avoided, for example by 
executing only programs that do not contain combination instructions, or switching between 

20 alternative versions of program that do and do not use combination instructions to 

accomplish the same task respectively, or by translating the combination instructions into 
instructions executed by different functional units in successive cycles. 

In this way, increased power saving can be realized, because when the device 
executes at a slow clock rate the total number of instructions that has to be issued to execute a 

25 processing task can be reduced by combining instructions into a combination instruction, for 
which the issue slot needs to be active only during one instruction cycle. When the 
combination instruction does not use up more instruction cycles than normal instructions its 
use reduces the time needed to execute a program, making it possible to reduce the clock rate 
even further for a processing task that has to be executed in a specified time interval. 

30 In another embodiment the processing device is a VLIW processor that 

contains a plurality of functional units to which instructions from an instruction word can be 
issued in parallel, for execution in parallel. In this embodiment a bypass coupling is provided 
from a result output of a further functional unit, which receives an instruction in parallel with 
the group of functional units that receives the combination instruction, to an operand input of 
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the second one of the functional units that responds to the combination instruction and also 
receives the result of the first one of the functional unit. Preferably, the bypass connection 
contains no latch for pipelining the execution stage executed by the functional units over 
multiple instruction cycles. Thus, a VLIW instruction word may be used that contains a 
5 combination instruction for one group together with another instruction for a functional unit 
that delivers an operand used during execution of the combination instruction. As a result at 
sufficiently low clock speeds fewer instructions need to be issued, while still maintaining 
sufficient speed. 

In a further embodiment execution of the combination instruction may extend 
10 over more than one instruction cycle. Thus, the combination instruction can also be executed 
at clock rates at which series execution does not fit within one instruction cycle. In one 
embodiment intermediate registers are provided to latch results that are routed from one 
functional unit to another when both functional units respond to the combination instruction. 
However, this requires additional power consumption by the register and it splits execution. 
1 5 , In another embodiment no register is used between the functional units, making use of wave 
pipelining to pass results from one functional unit to another in part of an interval that spans 
more than one instruction cycle. 



20 These and other objects and advantageous aspects of the invention will be 

described using the following figures 

Figure 1 shows a processing device 

Figure 2 shows .) group of functional units 

Figures 3a,b show timing aspects 
25 Figure 4 shows a plurality of groups of functional units 

Figure 5 shows a further group of functional units 



Figure 1 shows a processing device comprising an instruction memory 17, an 
30 instruction issue unit 10, with an issue slot 1 1, a group of functional units 12, a register file 
14, a clock circuit 16, a clock rate selection circuit 18 and a program counter 19. Program 
counter 19 has an output coupled to an address input of instruction memory 17. Instruction 
memory 17 has an output coupled to instruction issue unit 10. Issue slot 1 1 of instruction 
issue unit 10 contains outputs for an operation code coupled to group of functional units 12 
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and a first operand register address and a second operand register address and a result register 
address coupled to register file 14. Group of functional units 12 has operand inputs coupled 
to outputs of register file 14 and a result output coupled to an input of register file 14. 

Although only one group of functional units 12 is shown, it should be 
5 understood that a plurality of groups may be present in parallel. In this case instruction issue 
unit contains a respective issue slot for each group of functional units, with an output coupled 
to an operation code input of the relevant group and register address outputs coupled to 
register file 14. Also in this case register file 14 has a separate result input for each group of 
functional units, as well as a separate operand output. 
10 Clock rate selection circuit 18 has an output coupled to a control input of clock 

circuit 16 and program counter 19. Clock circuit 16 has a clock output coupled to instruction 
issue unit 10 and register file 14. Instruction issue unit 10 is coupled to program counter 19. 
In operation a clock signal from clock circuit 16 defines successive instruction cycles. 
Normally a respective instruction is executed in each instruction cycle. In each instruction 
1 5 cycle instruction issue unit 1 0 issues an operation code of a command that is part of an 

instruction to group of functional units 12. Similarly, instruction issue unit 10 issues operand 
register addresses for an instruction to register file 14 in each instruction cycle and instruction 
issue unit 10 issues a result register address for an instruction to register file 14 in each 
instruction cycle. Due to pipelining, the operation code, operand register addresses and result 
register address that are issued in the same instruction cycle may belong to different 
instructions. 

In an instruction cycle group of functional units 12 executes a command 
identified by the operation code from instruction issue unit 10, using on* or move operands 
received from register file 14. 

Figure 2 shows group of functional units 12 in more detail. Group 12 contains 
a plurality of functional units 20a,b (only two shown for the sake of clarity, but more may be 
present). Operand inputs 22a,b of group 12 are coupled to operand inputs of functional units 
20a,b. Result outputs of functional units 20a,b are coupled to a result output of group 12 via 
an output multiplexer 26. An operation code input 24 is coupled to operation code inputs of 
functional units 20a,b and output multiplexer 26 (preferably operation code 24 is coupled to 
functional units 20a,b and output multiplexer 26 via a pre-decoder, but this is not shown for 
the sake of clarity). 

Group 12 also contains a control unit 28 and an input multiplexer 29. Input 
multiplexer 29 has a first input coupled to operand input 22a of the group and an output 
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coupled to an operand input of a second functional unit 20b. A second input of input 
multiplexer 29 is coupled to a result output of a first functional unit 20a. Control unit 28 is 
coupled to operation code input 24 and has an output coupled to a selection input of input 
multiplexer 29. 

5 In operation, received operation codes of a first type each identify one of the 

functional units 20a,b which executes the operation code. For operation codes of this first 
type control unit 28 makes input multiplexer 29 pass the operand from operand input 22b. 
The identified functional unit 20a,b executes a processing operation (for example ADD, or 
Multiply) identified by the operation code, using the operands applied to its operand inputs. 
10 The identified functional unit 20a,b outputs a result. Output multiplexer 26 passes the result 
from the identified functional unit 20a,b to the result output of the group of functional units 
12. 

Figure 3a shows timing aspects of execution of operations by functional units 
20a,b. On top a trace 30 indicates successive instruction cycles. Each instruction cycle lasts 

1 5 for a duration of Tl . Below the top line minimum time intervals 32, 34 have been indicated 
that are needed by ■functional units 20a,b to produce results during execution. Time intervals 
32, 34 may depend on the kind of operation that is selected by the operation code, on the ' 
functional unit 20a,b that executes the operation and the operand data used in the operation. 
However, the result is always available before the end of the instruction cycle, i.e. the 

20 duration of the intervals is shorter than Tl. It should be noted that figure 3 a only shows ■ 

intervals needed for execution in a functional unit. In practice, operation may be pipelined, so 
that processing of each instruction involves an instruction fetch stage, an operand fetch stage, 
an execution stage and a result write stage, the different stages being executed in successive 
instruction cycles, if need be after latching intermediate results. Time intervals 32, 34 

25 concern only the execution stage. 

The operation codes also include operation codes of a second type, which 
result in operation of a cascade of functional units 20a,b. When an operation code of the 
second type is applied to operand input 24, control unit makes input multiplexer 29 pass a 
result from a first one of the functional units 20a to an operand input of a second one of the 

30 functional units 20b. Output multiplexer 26 passes the result from second one of the 
functional units 20b to the result output of group of functional units 12. 

As an example of an operation code of the second type is an operation code for 
the computation of an operand to a sum of a square 
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result - A* A+B 

In this example, first functional unit 20a of group 12 is a multiplier and second functional 
unit 20b of group 12 is an adder. The operation has the register addresses of registers that 
5 contain A and B as operands. In response to the operation code first functional unit 20a of 
group 12 forms the product A*A. In response to the same operation code control unit 28 
causes multiplexer 29 to pass the products A*A as operand to second functional unit 20b of 
group 12. Still in response to the same operation code second functional unit 20b of group 12 
forms a sum A*A+B of the received products A*A and the operand B. It should be 

10 appreciated that this operation code is merely an example. Operation codes may be provided 
for other operations (e.g. A*A-B, A/((A+B), etc. A*B+A), a single such operation code may 
be supported or a plurality. 

When more operands are available either through inclusion of more than two 
operand register addresses in a command, or through inclusion of more than one operand in 

1 5 the same register, more complicated operations may be executed. E.g. when operands contain 
pairs Of numbers (ReA,ImA) and (ReB, ImB) that each represent the real part and the 
imaginary part of a complex number, a combination operation may instruct multiplier 
functional units to form products of the real parts (ReA*ReB) and of the imaginary parts 
(ImA*ImB) respectively and an adder to sum the products. In this case, group 12 preferably 

20 contains at least two multipliers and an adder as functional units, as well as multiplexers 

under control of control unit 28 to select whether the adder receives operands from operand 
inputs 22a,b or from the multipliers. 

figure 3b shows timing aspects of die execution stage of execution of an 
operation selected by an operation code of the second type. In this case, the duration of 

25 instruction cycles is T2. The duration of time interval 36 needed before a result of this 

operation is available is a sum of a duration of a first time interval 36a needed by the first one 
of the functional units 20a, a duration of a second time interval 36b needed to pass the result 
of the first one of the functional units 20a to the operand input of the second one of the 
functional units 20b and a duration of a third time interval 36c needed by the second one of 

30 the functional units 20b (To be more precise, instead of the duration of second time interval 
36b one should consider a difference between the duration of the time interval needed to pass 
the result from the output of the first one of the functional units 20a to the operand input of 
the second one of the functional units 20b minus the duration of the interval needed to pass 
an external operand to this operand input; this difference may be negative). 
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The overall duration of the interval 36 before the result of an operation of the 
second type is available is longer than the duration of the intervals 36a, 36c needed by the 
functional units 20a,b for the operations of which the operation is made up. Nevertheless this 
overall duration should fit within the duration T2 of an instruction cycle. 
5 Clock rate selection circuit 1 8 supplies a signal to clock circuit 1 6 to select the 

clock rate, i.e. the duration Tl or T2 of the instruction cycle. Preferably, the clock rate is set 
as low as possible (to an instruction cycle duration that is as long as possible) without 
compromising the ability to executed of required tasks within a required time- interval. By 
reducing the clock rate power consumption of the device is reduced. 

10 The selectable clock rates include a slow clock rate at which the duration 

execution of instructions of the second type fits within an instruction cycle (duration T2) and 
a fast clock rate at which the duration execution of instructions of the second type does not fit 
within an instruction cycle (duration Tl). When the clock rate is set at the slow clock rate a 
task is executed using instructions with operation codes of the second type. When the clock 

1 5 rate is set at the fast clock rate the task is executed without using instructions with operation 
codes of the second type, e.g. by replacing each instruction with an operation code of the 
second type by more than one instruction with an operation code of the first type. By using 
instructions with operation codes of the second type at the slow clock rate the number of 
instruction cycles needed to execute a task is reduced. Thereby execution speed is increased. 

20 Any way of adapting the instructions employed in executing the task may be 

used. In one embodiment, instruction memory 17 stores instructions of at least two programs 
for executing the same task, one using instructions with operation codes of the first type and 
another one not using such instructions. In this embodiment clock rate selection circuit 1 8 
selects the relevant program in addition to the clock rate, for example by setting the initial 

25 value of program counter 1 9 at the start of execution of the task. 

However, many other ways may be used to avoid the use of operation codes of 
the second type during execution of the task. For example, instructions may be executed to 
jump to either a program with operation codes of the second type or without this type of 
operation codes, dependent on the clock rate that has been set Similarly, translation of 

30 instruction addresses into physical memory addresses may be made dependent on the selected 
clock rate so as to select the appropriate instructions. In these cases it is not necessary to 
provide alternative versions (with and without operation codes of the second type) of the 
whole program for executing a task: instead alternative versions may be provided only for 
sections of the program that contain such instructions (in this case instructions with operation 
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codes of the second type are preferably included only in frequently executed sections). As an 
alternative instruction issue unit may even be arranged to translate an instruction with an 
operation code of the second type into a plurality of instructions without such operation codes 
on the fly, if the fast clock rate has been selected. 
5 Preferably the operation codes of the second type support frequently executed 

instructions. 

Although the invention has been illustrated by means of an embodiment with a 
clock rate selection circuit 18, it will be understood that the clock rate may be selected in 
other ways, for example under control of the part of the program counter value, so that the 

10 clock rate is set dependent on the segment of a program from which instructions are being 
executed, or under control of instructions from the program. 

Figure 2 illustrates an embodiment in which several functional units 20a,b 
respond to the same operation code of the second type. In addition control unit 28 responds to 
this operation code and output multiplexer 26 outputs a result from only one of the 

■ 1 5 responding functional units 20a,b. However, it will be understood that a (pre-)decoder (not 
shown) may used that detects which functional units must be activated in response to an 
operation code and that activates these functional units 20a,b. In this case the (pre-)decoder 
activates one functional unit 20a,b per instruction cycle when the operation code is of the first 
type and a combination of functional units when the operation code is of the second type. 

20 As shown, each of the functional units 20a,b that is activated in response to the operation 
code of the second type is also able to respond individually to an operation code of the first 
type. Thus, instruction units 20a,b are efficiently reused. However, in an alternative, a part of 
llie functional units 20a,b that is used to execute an operation code of the- second type in 
cascade may be of a type that does not respond individually to any operation code of the first 

25 type. Thus a certain overhead has to be introduced into the group of functional units 12. 

Although only a single input multiplexer 29 is shown by way of example, and 
only two functional units 20a,b, it will be understood that in practice more complicated 
connection networks may be provided between the outputs of functional units 20a,b or 
additional function units (not shown) in group 12. 

30 Figure 4 shows two groups 12, 40 of functional units for use in a processing 

device as shown in figure 1, implementing a further aspect of the invention. Each of the 
groups 12, 40 has an operation selection input 24, 48 coupled to a respective issue slot from 
the instruction issue unit (not shown), and to read and write ports of the register file (not 
shown). Thus, the device is a VLIW processor (Very Long Instruction Word processor) that 
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contains multiple, substantially independently selectable commands for different groups 12, 
40. A first one of the groups 12 is arranged as shown in figure 2, except that a further 
multiplexer 44 has been added, to a first input of which the second operand input 22b of 
group 12 is coupled. An output of further multiplexer 44 is coupled to an operand input of 
5 second functional unit 20b. Further multiplexer 44 has a control input coupled to control unit 
28. 

A second group of functional units 40 contains a number of functional units 
40a, 40b. The output of one of the functional units 40b of second group 40 is coupled to a 
second input of further multiplexer 44 via a bypass connection 42. 
10 In operation control unit 28 recognizes when the operation code of a 

combination instruction is issued to group of functional units 12. If so, control unit 28 causes 
multiplexers 29, 44 to pass operands from the first functional unit 20a of group 12 and from 
functional unit 40b of further group 40 to the operand inputs of second functional unit 20b of 
group 12. Both first and second functional unit 20a,b of group 12 respond to the combination 
1 5 . instruction, first functional unit 20a receiving operands from the operand inputs 22a,b of 
group 12, multiplexer 26 passing the result from second functional unit 20b to the write port 
of register file that is provided for group 12. 

A program stored in instruction memory 17 contains an instruction that 
contains commands for both groups 12, 40. The instruction contains a combination command 
for a first group 12 and the command for the second group 40 contains an operation code that 
activates second functional unit 40b of the second group. Thus, in response to the instruction, 
both first functional unit 20a of first group 12 and second functional unit 40b of second group 
40 produce results that are used as operands by second functional unit 2ub of group 12. The 
result from second functional unit 40b of second group 40 is passed between the groups 12, 
40 via bypass connection 42. Multiplexers 29, 44 pass the results as operands to second 
functional unit 20b of first group 12. 

As an example, this type of instruction may be used for a multiply-add 
operation in which the products of two pairs of operands are added 

result = A*B+C*D 

In this example, first functional unit 20a of first group 12 is a multiplier, second functional 
unit 40b of second group 40 is a multiplier and a second functional unit 20b of first group 12 
is an adder. The instruction contains a multiply-add command (the combination command) 



WO 2004/114128 



PCT/IB2004/050964 



that is issued to first group 12 and a multiply command that is issued to second group 40. The 
multiply-add command has the register addresses of registers that contain A and B as 
operands and the multiply command has the addresses of registers that contain C and D as 
operands. In response to the instruction first functional unit 20a of first group 12 and second 
5 functional unit 40b of second group 40 form the product A*B and C*D respectively. In 
response to the same multiply-add instruction control unit 28 causes multiplexers 29, 44 to 
pass these products as operands to second functional unit 20b of first group 12. Still in 
response to the same multiply-add instruction second functional unit 20b of first group 12 
forms a sum A*B+C*D of the received products A*B and C*D. 

10 This type of combined multiplication and addition is a frequently occurring 

combination of instructions, for example in multiplication of complex numbers and therefore 
the instruction realizes considerable savings in the number of instructions that need to be 
issued for this type of operation. However, it should be realized that the invention is not 
limited to this instruction. For example, a similar technique could be applied to multiplication 

15 and subtraction, to compute A*B-C*D, or to any other combination of operations that occurs 
in certain program. The device may support an operation code for one combination • . 
instruction only or for a plurality of such instructions. 

It should be noted that, when executing a program with the functional units of 
the embodiment of figure 4, when the instruction cycle rate is too fast to accommodate the 

20 delays of second functional unit 40b of second group 40 and second functional unit 20b of 
first group 12 in succession, the program may be adapted so as to eliminate combination 
instructions, as discussed in the content of figure 2. The combination instruction may provide 
for selection of results from different functional units (.alternative to second functional unit 
40b of second group 40) for use as operand for second functional unit 20b of first group 12. 

25 These different functional units may be part of a single group 40 or of a plurality of different 
groups. Without deviating from the invention second group 40 may contain only one 
functional unit (second functional unit 40b). 

Figure 5 shows an alternative group of functional units 12 for use in the 
device. In the embodiments show this far, the combination operation is executed in a single 

30 instruction cycle. In the embodiment of figure 5 multiple instruction cycles are used. Group 
of functional units 12 contains a control register 50 with an input coupled to control unit 28 
and outputs coupled to control inputs of multiplexers 29, 44 and second functional unit 20b. 
First data inputs of multiplexers 29, 44 are connected to operand inputs 22a,b. Result 
registers 52, 54 are provided with outputs coupled to second data inputs of multiplexers 29, 
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44. Inputs of result registers 52, 54 are coupled to the result outputs of one or more functional 
units (e.g. 20a) in group 12 and/or to the result outputs of one or more functional in other 
groups (not shown). The input connections are not shown for the sake of clarity. 

In operation, control unit 28 responds to a combination instruction issued for 
5 execution in a first instruction cycle by causing control register 50 to load information for 
controlling multiplexers 29, 44 and second functional unit 20b of first group 12. This 
information controls multiplexers 29, 44 and second functional unit 20b of first group 12 in a 
second instruction cycle that follows the first instruction cycle. In the second instruction 
cycle results latched in result registers 52, 54 are passed as operands to second functional unit 
10 20b of group 12 and this second functional unit 20b receives a control signal to execute its 
part of the command implied by the combination instruction in the second instruction cycle. 
In response second functional unit 20b produces a result at the end of the second instruction 
cycle. 

In this way a next instruction can be executed in group 12 in the second 

15 instruction cycle, in parallel with execution of part of the combination instruction by second . 
functional unit 20b. For example, execution of a first instruction to compute A*B-C*D could : 
be started in a first instruction cycle and a second instruction to compute A*D+B*C could be 
started in the next instruction cycle. Thus, the real and imaginary parts of two numbers A+iC 
and B+iD are computed using two instructions. 

20 Of course it should be avoided that a conflict occurs between the results from 

both the combination instruction and the next instruction. This may be realized in various 
ways. In one embodiment the next instruction is selected from a subset of instructions that do 
not produce a result in the second instruction cycle te.g. another combination instruction, or a 
NOP instruction). In this embodiment control register 50 also controls output multiplexer 26 

25 to pass the result from second functional unit 20b. In another embodiment a bypass register 
(not shown) may be used to pass the result of second functional unit 20b in parallel with the 
result from the functional unit that responds to the next instruction. 

It should be noted that in the embodiment of figure 5 the program need not be 
adapted when the instruction cycle rate is too fast to accommodate the delays of the first and 

30 second functional unit 20a,b in a single instruction cycle. 

Although figure 5 shows result registers 52, 54 inserted before multiplexers 
29, 44, these registers 52, 54 may be omitted if wave pipelining is used. In this case 
propagation delays within the functional units 20a,b are used to allow results from the 
combination instruction and the next instruction to be present simultaneously at the outputs 
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of second functional unit 20b and the functional unit that executes the next instruction. In a 
further embodiment registers may be provided in front of the particular functional units that 
produce the results used by second functional unit 20b of first group 12. These registers are 
arranged to respond to the combination instruction by latch the operands of these functional 
5 units and to supply these operands, after the operands have been applied directly from inputs 
22a,b in a first instruction cycle, to the particular functional units also during a subsequent 
instruction cycle. 

Although the invention has been illustrated using combination instructions 
involving successive execution of two functional units in series in response to the same 
10 command, it will be understood that combination commands may be provided involving a 
greater number of functional units in series. 



